VoltanaLLM: Energy-Efficient LLM Serving

VoltanaLLM: Feedback-Driven Frequency Control and State-Space Routing for Energy-Efficient LLM Serving.

View Post on Scour ↗

More from supercomputing-system-ai-lab.github.io on Scour.

Discussed on Hacker News